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'-We-prOve-that  the  scale  map  of  the  ze|-o-crossings  of  almost  all  signals  filtered  by  the  second 
derivative  of  a  gaussian  of  variable  size  determines  the  signal  uniquely,  up  to  a  constant 
scaling  and  a  harmonic  function.  Our-  proof  provides  a  method  for  reconstructing  almost 
all  signals  from  knowledge  of  how  the  zero  crossing  contours  of  the  signal,  filtered  by  a 
gaussian  filter,  change  with  the  size  of  the  filter.  The  proof  assumes  that  the  filtered  signal 
can  be  represented  as  a  polynomial  of  finite,  albeit  possibly  very  high,  order.  An  argument 
suggests  that  this  restriction  is  not  essential.  Stability  of  the  reconstruction  scheme  is  briefly 
discussed.  The  result  applies  to  zero-  and  level-crossings  of  linear  differential  operators 
of  gaussian  filters.  The  theorem  is  extended  to  two  dimensions,  that  is  to  images.  These 
results  are  reminiscent  of  Logan's  theorem.  They  imply  that  extrema  of  derivatives  at 
different  scales  are  a  complete  representation  of  a  signal. 
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1.  Introduction 


Images  are  often  described  in  terms  of  "edges",  that  are  usually  associated  with  the  zeros 
of  some  differential  operator.  For  instance,  zero-crossings  in  images  convolved  with  the 
laplacian  of  a  gaussian  have  been  extensively  used  as  the  basis  representation  for  later 
processes  such  as  stereopsis  and  motion  (Marr,  1982).  In  a  similar  way,  sophisticated 
processing  of  1-D  signals  requires  that  a  symbolic  description  must  first  be  obtained,  in 
terms  of  changes  in  the  signal.  These  descriptions  must  be  concise  and,  at  the  same  time, 
they  must  capture  the  meaningful  information  contained  in  the  signal. 

It  is  clearly  important,  therefore,  to  characterize  in  which  sense  the  information  in  an  image 
or  a  signal  is  captured  by  extrema  of  derivatives. 

Ideally,  one  would  like  to  establish  a  unique  correspondence  between  the  changes  of 
intensity  in  the  image  and  the  physical  surfaces  and  edges  which  generate  them  through 
the  imaging  process.  This  goal  is  extremely  difficult  to  achieve  in  general,  although  it 
remains  one  of  the  primary  objectives  of  a  comprehensive  theory  of  early  visual  processing. 

A  more  restricted  class  of  results,  that  does  not  exploit  the  constraints  dictated  by  the  signal 
or  image  generation  process,  has  been  suggested  by  work  on  zero-crossings  of  images 
filtered  with  the  laplacian  of  a  gaussian.  Logan  (1977)  had  shown  that  the  zero-crossings  of 
a  1-D  signal  ideally  bandpass  with  a  bandwidth  of  less  than  an  octave  determine  uniquely 
the  filtered  signal  (up  to  scaling).  The  theorem  has  been  extended— only  in  the  special  case 
of  oriented  bandpass  filters— to  2-D  images  (Poggio,  et  al.,  1982;  Marr,  et  al.,  1979)  but  it 
cannot  be  used  for  gaussian  filtered  signals  or  images,  since  they  are  not  ideally  bandpass. 
Nevertheless,  Marr  et  al.  (1979)  conjectured  that  the  zero-crossings  maps,  obtained  by 
filtering  the  image  with  the  second  derivative  of  gaussians  of  variable  size,  are  very  rich  in 
information  about  the  signal  itself  (see  also  Grimson,  1981;  Marr  and  Hildreth,  1980;  Marr, 
1982;  for  multiscale  representations  see  also  Crowley,  1982  and  Rosenfeld,  1982  also  for 
more  references). 

More  recently,  Witkin  (1983)  (see  also  Stansfield,  1980)  introduced  a  scale-space  description 
of  zero-crossings,  which  gives  the  position  of  the  zero-crossing  across  a  continuum  of  scales, 
i.e.,  sizes  of  the  gaussian  filter  (parametrized  by  the  a  of  the  gaussian).  The  signal — or  the 
result  of  applying  to  the  signal  a  linear  (differential)  operator— is  convolved  with  a  gaussian 
filter  over  a  continuum  of  sizes  of  the  filter.  Zero-  or  level-  crossings  of  the  filtered  signal  are 
contours  on  the  x  —  a  plane  (and  surfaces  in  the  x,y ,a  space).  The  appearance  of  the  scale 
map  of  the  zero-crossing — an  example  is  shown  in  Figure  1— is  suggestive  of  a  fingerprint. 
Witkin  has  proposed  that  this  concise  map  can  be  effectively  used  to  obtain  a  rich  and 
qualitative  description  of  the  signal.  Furthermore,  it  has  been  proved  in  1-D  (Babaud  et  al, 
1983;  Yuille  and  Poggio,  1983)  and  2-D  (Yuille  and  Poggio,  1983)  that  the  gaussian  filter  is 
the  only  filter  with  a  “nice"  scaling  behavior,  i.e.,  a  simple  behavior  of  zero-crossing  across 
scales,  with  several  attractive  properties  for  further  processing.  In  this  paper,  we  prove  a 
stronger  completeness  property:  the  map  of  the  zero-crossing  across  scales  determines  the 
signal  uniquely  for  almost  all  signals  (in  the  absence  of  noise).  The  scale  maps  obtained 
by  gaussian  filters  are  true  fingerprints  of  the  signal.  Our  proof  is  constructive.  It  shows 
how  the  original  signal  can  be  reconstructed  by  information  from  the  zero-crossing  contours 
across  scales.  It  is  important  to  emphasize  that  our  result  applies  to  level-crossings  of  any 
arbitrary  linear  (differential)  operator  of  the  gaussian,  since  it  applies  to  functions  that  obey 
the  diffusion  equation. 

Our  fingerprints  theorems  can  be  regarded  as  an  extension  of  Logan's  result  to  gaussian 
filtered,  nonbandpass  signals  and  2-D  images.  There  are,  however,  some  important 
differences  between  Logan's  Theorem  and  the  fingerprints  theorems.  Logan  uses  a 
\  bandpass  filter,  at  one  scale  only,  and  shows  that  the  zero-crossings  determine  the  filtered 

signal.  His  proof  is  non  constructive  and  only  applies  in  1-D  (2-D  generalizations  exist 
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Figure  1  The  scale  map  of  the  zero-crossings  of  the  second  derivative  of  a  signal  (a  1-D 
slice  of  a  natural  image).  The  x  axis  is  the  abscissa;  the  scale,  i.e.  c,  increases  from  the 
bottom  to  the  top.  Our  theorem  states  that  this  map  is  a  true  fingerprint  since  it  determines 
uniquely  the  signal  (modulus  the  null  space  of  the  operator). 


(Poggio  et  al,1982]  but  none  are  fully  satisfactory).  The  fingerprints  theorems  determine 
the  original  image  from  the  zero-crossings  of  the  image  filtered  at  different  scales.  The 
proof  is  constructive  and  applies  in  both  1-D  and  2-D.  Reconstruction  of  the  signal  is  of 
course  not  the  goal  of  early  signal  processing.  Symbolic  primitives  must  be  extracted  from 
the  signals  and  used  for  later  processing.  Our  results  imply  that  scale-space  fingerprints 
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are  complete  primitives,  that  capture  the  whole  information  in  the  signal  and  characterize  it 
uniquely.  Subsequent  processes  can  therefore  work  on  this  more  compact  representation 
instead  of  the  original  signal. 

Our  results  have  theoretical  interest  in  that  they  answer  the  question  as  to  what  information 
is  conveyed  by  the  zero-  and  level-crossings  of  multiscale  gaussian  filtered  signals.  From 
a  point  of  view  of  applications,  the  results  in  themselves  do  not  justify  the  use  of  the 
fingerprint  representation.  Completeness  of  a  representation  (connected  with  Nishihara’s 
sensitivity)  is  not  sufficient  (Nishihara,  1981).  A  good  representation  must,  in  addition,  be 
ro bust  (i.e.  stable  in  Nishihara’s  terms)  against  photometric  and  geometric  distortions  (the 
general  point  of  view  argument).  It  should  also  possibly  be  compact  for  the  given  class  of 
signals.  Most  importantly  it  should  make  explicit  the  information  that  is  required  by  later 
processes.  Fingerprints  of  images  may  have  these  additional  properties.  Their  compactness 
property,  for  instance,  can  be  defended  with  the  same  type  of  heuristic  arguments  used  to 
justify  edge  detection.1 


2.  Assumptions  and  results 


We  consider  the  zero-crossings  of  a  signal  I(x),  space-scale  filtered  with  the  second 
derivative  of  a  gaussian,  as  a  function  of  x,  a.  Let  F  and  E  be  defined  by 


E(x,a)  =  I(x)  .  £*[G(x,a) |j  =  / '(f)^*P“^f-  (*•*] 

Notice  that  E[x,  a)  obeys  the  diffusion  equation  in  x  and  er: 


d2E  _  1  dE 
dx 2  a  da 


[2.2] 


We  restrict  ourselves  to  images,  or  signals,  P  such  that  E  can  be  expressed  as  a  finite 
Taylor  series  of  arbitrarily  high  order.  Observe  that  any  filtered  image  can  be  approximated 
arbitrarily  well  in  this  way. 

We  will  show  that  the  local  behavior  of  the  zero-crossing  curves  (defined  by  E(x,a )  ==  0)  on 
the  x  —  a  plane  determines  the  image  up  to  an  harmonic2  function  <p(x),  such  that  -£f<p  =  0. 
The  proof  of  this  result  will  then  be  generalized  to  2-D.  We  will  also  discuss  its  (obvious) 
extension  to  zero-  and  level-crossings  of  linear  (differential)  operators.  More  precisely  we 
will  prove  the  following  theorem: 

Theorem  1:  The  derivatives  (including  the  zero-order  derivative)  of  the  zero-crossings 
contours  defined  by  E(x,o)  =  0,  af  two  distinct  points  at  the  same  scale,  determine  uniquely 

’  Clearly,  the  scale  map  fingerprint  cannot  always  be  a  more  concise  description  of  the  signal  than 
the  signal  itself,  unless  the  signal  is  redundant  in  precisely  the  way  that  the  fingerprint  representation 
can  exploit.  We  expect  this  to  be  the  case  for  images,  if  an  appropriate  differential  operator  is 
used,  because  images  are  not  a  purely  random  array  of  numbers.  Usually  images  consist  of  rather 
homogeneous  regions  that  do  not  change  much  over  significant  scale  intervals. 

’This  indeterminancy  is  not  a  problem.  It  has  long  been  known  that  the  human  visual  system  is  rather 
insensitive  to  linear  illumination  gradients.  Our  reconstruction  scheme  provides  the  Laplacian  of  the 
image  I  in  terms  of  Hermite  polynomials.  It  is  easy  to  integrate  a  function  of  this  type  to  obtain  /. 
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a  signal  of  class  P  up  to  an  harmonic  function  of  x  and  constant  scaling  (except  on  a  set 
of  measure  zero).3 

Note  that  the  theorem  does  not  apply  to  signals  that  do  not  have  at  least  two  distinct 
zero-crossings  contours.  Another  remark  is  relevant  here:  the  gaussian  filter  seems  critical 
for  our  proof,  but  we  cannot  show  that  it  is  the  only  filter  with  this  property.  In  section  4 
we  will  extend  Theorem  1  to  the  two  dimensional  case: 

Theorem  2:  Derivatives  of  the  zero-crossings  contours,  defined  by  E(x,y,o)  =  0,  at  two 
distinct  points  at  tne  same  scale,  uniquely  determine  an  image  of  class  P  up  to  an  harmonic 
function  of  x,y  and  a  scaling  factor  (except  on  a  set  of  measure  zero). 

If  the  signal  is  not  a  polynomial,  a  similar  weaker  result  can  be  proved.4  A  best  solution 
can  always  be  found  but  it  may  not  be  unique.  These  theorems  break  down  when  all  the 
zero-crossing  contours  are  independent  of  scale  (i.e.  the  contours  go  straight  up  in  the 
scale  space  fingerprint).  This  is  a  rare,  though  interesting,  special  case  and  is  discussed 
in  detail  in  a  future  paper  [Yuille  and  Poggio  1983,  in  preparation].  It  can  only  occur  for 
functions  which  cannot  be  represented  as  finite  polynomials. 

The  theorems  do  not  directly  address  the  stability  of  this  reconstruction  scheme.  The  first 
question  concerns  stability  of  the  reconstruction  of  the  filtered  function  E(x,o)  at  the  a 
where  the  derivatives  are  taken.  Note  that  our  result  relies  only  on  two  points  on  the 
zero-crossing  contours.  Exploitation  of  the  whole  zero-crossings  contours  should  make 
the  reconstruction  considerably  robust.  The  second  question  is  about  the  stability  of  the 
recovery  of  the  unfiltered  signal  V-/(x)  from  E(x,o).  This  is  equivalent  to  inverting  the 
diffusion  equation,  which  is  numerically  unstable.  Reconstruction  is,  however,  possible  with 
an  error  depending  on  the  signal  to  noise  behaviour  (see  later).5 

2.1.  Outline  of  the  1-D  Proof 

We  summarize  here  the  1-D  proof  from  a  slightly  different  point  of  view  that  clarifies  its  bare 
structure. 

The  proof  starts  by  taking  derivatives  along  the  zero  crossing  contours  at  a  certain  point. 
Such  derivatives  split  into  combinations  of  x  and  f  derivatives  (where  t  =  cr2/2).  Because 
the  filter  is  assumed  to  be  gaussian,  however,  derivatives  can  be  expressed  in  terms  of  x 
derivatives.  This  is  a  key  point:  since  the  filtered  signal  E(x,  t)  satisfies  the  diffusion  equation, 
the  t  derivatives  can  be  expressed  in  terms  of  the  x  derivatives  simply  by  Et  =  EX1.  The  next 
stage  is  to  find  the  x  derivatives  of  E(x,  t)  up  to  an  arbitrary  degree  n  from  such  derivatives 
along  the  zero  crossing  contours  in  the  x  —  t  plane.  We  show  that  this  can  be  done  by 
using  2  points  on  2  contours.  (It  is  possible  that  one  point  is  sufficient,  but  we  are  as  yet 
unable  to  prove  this.)  Since  E(x,t)  is  entire  analytic,  because  of  the  gaussian  filtering  (see 
Appendix  2),  it  can  be  represented  by  a  Taylor  series  expansion  in  x.  Since  we  know  the 
values  of  the  n  derivatives  of  E(x,t)  with  respect  to  x,  we  know  its  Taylor  series  expansion 
and  hence  E(x,  t).  The  unfiltered  signal  F(x),  (E(x,t)  —  F(x)  *  G(x,  t ))  can  then  be  recovered 

*  For  a  general  operator  the  reconstruction  is  modulus  the  null  space  of  the  operator.  Harmonic 
functions  are  the  null  space  of  the  Laplacian. 

*  In  this  case,  the  signal  is  determined  by  the  zero-crossing  contours  in  the  L2  sense  only.  This 
means  that  the  signal  may  not  be  determined  correclly  on  a  set  of  measure  zero.  However,  if  the 
image  is  assumed  to  be  an  analytic  entire  function  (see  Appendix  2),  section  3.4  implies  that  it  can  be 
determined  exactly  everywhere.  Since  images  •  like  any  physical  signal  •  are  effectively  bandlimited  by 
the  measurement  (or  imaging)  process,  they  can  be  considered  as  restrictions  to  the  reals  of  analytic 
entire  functions  (see  Appendix  2), 

slf  E(z,c)  is  obtained  at  all  a  -  this  can  be  done  by  applying  the  reconstruction  scheme  at  two 
points  at  each  a  -  robust  reconstruction  of  l(x )  can  be  achieved  in  Ihe  following  way  (Hummel  and 
Zucker,  in  prep.).  Since  /  E(z,  t)dt  =  •/(/ » G),,dt  —  f(l  *  G),dt  —  E(z,  0)  with  the  integration  between 
0  and  oo,  I(x)  can  be  reconstructed  by  integraling  E(z,o)  across  a  (with  t  =  <y=/2  the  diffusion 
equation  is  E,z  =  E,).  In  practice,  the  limits  of  integration  will  be  finite,  originating  small  errors  in  the 
reconstruction. 
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in  the  ideal  noiseless  case  by  deblurring  the  gaussian.  A  particularly  simple  way  of  doing 
this  is  provided  by  a  property  of  the  function  <f>n  in  which  we  will  expand  the  function  F :  the 
coefficients  of  an  expansion  of  F(x)  in  terms  of  4>n  are  equal  to  the  coefficients  of  the  Taylor 
series  expansion  of  E(x,  t).  In  the  presence  of  noise,  the  recovery  of  F(x)  from  E(x,t)  is 
obviously  unstable.  It  is  limited  by  S/N  ratio  since  high  spatial  frequencies  in  the  signal  are 
masked  by  the  noise  for  increasing  t.  (For  instance,  if  F{x)  =  £  the  filtered  signal 
is  E(x,t)  =  Note  that  since  the  zero-crossing  contours  are  available  at  all 

scales  a  reconstruction  scheme  that  exploits  more  than  2  points  will  be  significantly  more 
robust.  As  one  would  expect,  the  reconstruction  of  the  unfiltered  signal  is  therefore  affected 
by  noise.  The  reconstruction  of  the  filtered  signal  E(x,t)  is  likely  to  be  considerably  more 
robust.  We  plan  to  study  theoretically  and  with  computer  simulations  the  noise  sensitivity  of 
the  reconstruction  scheme. 


3.  Proof  of  the  Theorem  in  1-D 

We  divide  our  proof  into  three  main  steps.  In  the  first  we  show  that  derivatives  at  a  point  on 
a  zero-crossing  contour  put  strong  constraints  on  the  "moments"  of  the  Fourier  tranform 
of  E(x,c)  (see  eq.  3.1.4).  The  second  section  relates  the  "moments"  to  the  coefficients  of 
the  expansion  of  F(x)  =  E( x,0)  in  functions  related  to  the  Hermite  polynomial.  In  the  third 
section  we  show  that  the  "moments"  can  be  uniquely  determined  by  the  derivatives  on  a 
second  point  of  a  different  zero-crossing  contour. 

3.1.  The  "moments"  of  the  signal  are  constrained  by  the  zero-crossing  contours 

Let  the  Fourier  tranform  of  the  signal  7(x)  be  /(w)  and  the  gaussian  filter  be  G(x,oj  =  £eT?r 
with  Fourier  transform  <?(cj)  =  e=*r*~. 

The  zero  crossings  are  given  by  solutions  of  E(x,t)  —  0.  Using  the  convolution  theorem  we 
can  express  E( x,  t)  as 


£(*,<)  =  yVwVwV7(  u>)du.  [3.1.1] 

and  <  =  <72/2.  The  Implicit  Function  theorem  gives  curves  x(t)  which  are  C°°  (this  is  a 
property  of  the  gaussian  filter  and  of  the  diffusion  equation,  see  Appendix  2  and  Yuille  and 
Poggio,  1983).  Let  f  be  a  parameter  of  the  zero  crossing  curve.  Then 

±  =  +  [3.1.2] 

d<  d(  dx  d(dt  11 

On  the  zero-crossing  surface,  E  =  0  and  -^E  —  0  for  all  integers  n.  Knowledge  of  the 
zero  crossing  curve  is  equivalent  to  knowledge  of  all  the  derivatives  of  x  and  t  with  respect 
to  f. 

We  compute  the  derivatives  of  E  with  respect  to  f  at  (x0lt„).  The  first  derivative  is  : 


E(x,t)=  */.  W,,e,wt(«w)w2/(w)<fw 


+ 


*/e 


13-1.3] 


)e'UIu2l(uj)du 


and  is  expressed  in  terms  of  the  first  and  second  moments  of  the  function  e  u',(e,WIw2/(w). 
The  moment  of  order  n  is  defined  by: 
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/oo 

(iui)nc~u>,tc,uzui2I(ui)d(J. 

-OO 

The  second  derivative  is 

+  (?)  /  e_"Vul(-w2)w2  J(w)dw 

+  2??  /  e_u'Jf(-lj2)e'u'1(»w)w2^(w)da' 
+  /  e-w,t(u,A)e-~,uzu2I{ij)(L). 


[3.1.4] 


[3.1.5] 


Since  the  parametric  derivatives  along  the  zero  crossing  curve  are  zero,  equation  [3.1.3]  is  a 
homogeneous  linear  equation  in  the  first  two  moments.  Similarly,  [3.1.5]  is  a  homogeneous 
linear  equation  in  the  first  four  moments.  In  general,  the  n"1  equation,  $^E(x,t)  =  0, 
is  a  homogeneous  equation  in  the  first  2n  moments.  We  choose  our  axes  such  that 
x0  =  0.  The  next  section  shows  that  the  moments  of  e-“2,u2/(u)  are  the  coefficients  a„ 
in  the  expression  of  the  function  F(x)  in  Hermite  polynomials.  So  we  have  n  equations 
in  the  first  2 n  coefficients  a„.  To  determine  the  a„  uniquely,  we  need  n  additional  and 
independent  equations  which,  as  we  will  show  in  section  3.3,  can  be  provided  by  considering 
a  neighboring  zero  crossing  curve  at  (into). 


3.2.  The  "moments"  are  the  coefficients  of  the  expansion  of  F(x) 

In  this  section  we  show  that  the  moments  defined  by  [3.1.4]  can  be  related  to  the  coefficients 
of  the  expansion  of  F(x)  in  functions  related  to  the  Hermite  polynomials.  We  expand 


F(s)=^/(z)  [3.2.1] 

in  terms  of  the  functions  y3„(x,  <x)  related  to  the  Hermite  polynomials  Hr{x)  (see  Appendix  1) 
by 


*»(*.  <0  =  (-!)"•  ~~ . 

{V2)n+'V*  V\/2<r' 


F{X)  =  52 

n^o 

The  coefficients  an(a)  of  the  expansion  are  given  by 


[3.2.2] 

[3.2.3] 


On(ff)  =  (wti(x,<r),F(z))  [3.2.4] 

where  (,)  denotes  inner  product  in  L2  and  (wn(z,a)}  is  the  set  of  functions  biorthogonal  to 
{<p„{x,o)}.  The  {<pn(x,o)}  are  given  explicitly  by 


<P n(x,a)  ~ 


gin-l  .  rfn 
- tlJ - 

nW dx " 


[3.2.5] 
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and  the  w„(x,a)  by 


wn[x,a)  =  (-1)" 


[3.2.6] 


Since 


F(x)  = 


[3.2.7] 


the  a„  are  given  by 


=  ~(-l)n  / [3.2.8] 

y/2*  J  ax 

The  inner  product  in  [3.2.8]  is  just  the  inverse  Fourier  transform  of  wn(x).  Therefore, 

a„(o)  =  J (i(jj)ne  ^  wJl(w)dw  [3.2.9] 

which  is  equal  to  modulus  a  factor  tiuz.  We  will  need  to  consider  the  derivatives  along 
the  zero  crossing  contours  at  two  points.  We  can  choose  coordinates  so  that  these  points 

are  (0,<r0)  and 

Therefore  knowledge  of  the  image  is  equivalent  to  knowing  the  an. 

3.3.  Combining  information  from  two  contours 

The  derivatives  at  ( xut« )  give  us  n  equations  in  the  first  2n  moments  of  e~ w,(e"JI‘wJ7(w). 
We  can  relate  them  to  the  expansion  coefficients  of  the  function 

F(x  +  n)=  J  c'uzc,ux'u>2~I{u)dLj  [3.3.1] 

in  terms  of  the  <f>n  functions. 

We  write 

7n 

F(*  +  x  i)  =  5>„V>„(*)  [3-3.2] 

0 

We  have  n  equations  for  the  2n  unknowns  bn.  Now  observe  that 

2  n  2n 

^f>nV5r,(l)  =  5Z«*nlFn(x  +  Xl)  [3.3.3] 

0  0 

Any  tpn{ x  +  x\)  can  be  expressed  as  a  linear  combination  of  <pm( x)  with  m  <  n,  as  we  will 
show  in  section  3.3.1. 

Thus  we  express  each  6„'s  in  terms  of  a„'s  and  then  we  combine  the  equations  from  two 
points  to  obtain  2 n  equatior.w  .or  the  2n  coefficients  on.  Thus  with  the  results  of  the  next 
two  sections  the  proof  will  be  complete. 
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3.3.1.  Change  of  basis 

For  a  given  a,  the  functions  <p„  are  given  in  terms  of  Hermite  polynomials  (see  eq.  3.2.2). 
We  show  how  we  can  express  Hermite  polynomials  with  origin  at  x  —  0  in  terms  of  Hermite 
polynomials  with  origin  at  x  =  —  x,  and  hence  perform  a  change  of  basis. 

We  show  that  H„{ x  —  ii)  can  be  expressed  as  a  linear  combination  of  //„( x)  with  m  <  n. 
Let  us  consider  the  generating  function  e“ p!+2rI  which  defines  the  Hermite  polynomials  as 


e-pJ+2p*  _  y'  H^X)V: 

n-0  n! 

Equation  [3.3.1. 1]  gives  at  x  +  x, 

e-p,+2F(*-xl)  _  y  H„(x-x l)f 

n*=*0  n‘ 

The  left  hand  side  of  equation  [3.3. 1.2]  can  be  expanded  as 


,+2pie-‘2pz,  _  ^2 


V'  (-2 *)mp" 


n! 


n«*0  m**0 

Term  by  term  comparison  of  equation  [3.3.1. 2]  and  [3.3.1. 3]  gives 


Hn(x-xt)=  £  (”)//m(xx-2i,r 

m—»0 

The  series  obtained  by  substituting  equation  [3.3.1. 4j  into 

/(*)=  53  bnHn(x  —  x,) 

is  a  series  of  the  form 


n—»0 


[3. 3.1.1] 


[3.3.1.2] 


[3.3. 1.3] 


[3.3. 1.4] 


'3.3. 1.5] 


E  <WX)  [3  3.1.6] 

that  converges  to  /(x)  as  the  following  argument  demonstrates.  If  }(x)  is  in  L2  it  can  be 
expanded  in  terms  of  the  Hn.  Similarly,  g(x)  =  /(x  —  ij)  is  also  in  L2  and  can  be  expanded 
as 


?(*)  =  53  c«w»(x)  [3.3. 1.7] 

n*0 

Thus,  f(x  —  x ,)  can  be  expressed  as  a  linear  combination  of  H„(x)  and  this  series  coincides 
with  eq. (3.3. 1.6)  because  of  the  uniqueness  of  the  expansion.  In  particular,  we  obtain  for 
the  <pn 


<p„{x  —  xi,t)  =  <p„[x,t)  +  xn0„_,(x,t)  +  ...  [3.3. 1.8] 

where  the  remaining  terms  are  functions  <pm(x,t),  with  m  <  n  —  1,  multiplied  by  polynomials 
in  X]. 
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Observe  that  if  we  restrict  ourselves  to  polynomial  functions  of  x  a  change  of  basis  will 
correspond  to  transformating  an  n  th  order  polynomial  in  x  into  an  n-th  order  polynomial 
in  x  —  x\.  This  argument  suffices  for  our  theorems  which  are  restricted  to  finite  polynomial 
functions  of  class  P.  For  the  sake  of  completeness,  however,  Appendix  3  deals  with  the 
general  case. 

3.4.  Independence  of  the  equations 

We  have  to  show  that  information  from  2  points  yield  a  unique  solution.  The  first  n  equations 
in  the  2n  first  moments  from  a  point  can  be  written  as 


#  0  o  a  0 

#  $  +  (ft)2  2 ££  ($0*  0 


M2(x) 

U Mx)7 


=  0 


(3.4.1) 


The  matrix  of  the  coefficients  is  a  nx2n  matrix.  Note  that  its  rows  are  linearly  independent 
(since  the  coefficients  of  the  r'h  row  vector  are  zero  after  the  2 rtU  component). 

The  next  n  equations  are  given  by  the  matrix  of  the  derivatives  at  a  second  point,  x,,  that 
have  the  same  form  as  eq.  (3.4.1),  multiplied  by  the  moments  at  (x  -p  ii). 


£ 


Hi  + 


0 

2$?# 


0> 

0 


(  Mi(x-f  x^ 
M2(x  -f  fci) 

^M2n(x  +  xi)) 


=  0. 


(3.4.2) 


The  moments  at  (x  +  x,)  can  be  expressed  in  terms  of  the  moments  at  x  by  the  following 
transformation  (see  section  3.3). 


1  *1  V 

Tt  • 

■  & 

Mi{x)\ 

f  M](x  -f  ii) A 

0  1  X, 

0  0  1 

Xl  . 

M,(x) 

= 

M2[x  +  xi) 

i. 

i  / 

,A/2n(x)>i 

^M2n(x  +  xi), 

Equation  (3.4.3)  substituted  into  (3.4.2)  gives,  together  with  equation  3.4.1,  the  full  set  of  2n 
equations  in  the  2 n  unknowns  M,(x).  The  2n  x  2n  matrix  of  the  coefficients  can  be  thought 
of  as  originating  from  the  first  point  (the  top  half)  and  from  the  second  point  (the  bottom 
half)  on  the  zero-crossing  curves. 

In  general,  the  determinant  of  this  matrix  is  non-zero.  Intuitively,  if  the  filtered  signal  has 
nonzero  moments  of  order  higher  than  2 n,  the  system  of  2 n  equations  would  not  have  a 
solution.  A  proof  for  this  claim  is  given  in  Appendix  4,  The  argument  is  based  on  the  fact 
that  the  determinant  of  the  coefficients  is  a  polynomial  in  ij.  If  this  vanishes,  then  x\  can 
be  expressed  in  terms  of  the  first  n  derivatives  at  the  two  points.  We  show,  however,  that 
in  general  it  is  possible  to  change  x  continuously  without  altering  the  first  n  derivatives. 
This  implies  that  the  determinant  is  almost  always  different  from  zero.  The  argument  breaks 
down  if  the  filtered  signal  is  a  polynomial  of  degree  2 n  or  less. 

In  this  case,  the  determinant  must  be  zero,  since  the  homogeneous  set  of  equations  has 
at  least  one  solution.  At  this  point,  we  have  to  show  that  the  solution  is  unique.  We  first 
observe  that  the  determinant  of  the  coefficients  of  the  2n  x  2n  system  of  equations  is  a 
polynomial  in  x(.  This  polynomial  is  nontrivial6  since  the  first  n  and  the  second  n  equations 

c  This  argument  cannot  be  applied  when  all  zero- crossing  contours  aie  vertical  straight  lines:  in  this 
case  it  is  impossible  to  reconstruct  the  signal  [Yuille  and  Poggio  1983,  in  preparation) 
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separately  are  independent.  It  follows  that  the  determinant  vanishes  at  a  finite  number  (at 
most  2n)  of  values  of  xx. 

Suppose  the  determinant  is  zero.  Observe  that  x,  is  known  from  the  position  of  the  zero¬ 
crossing  curves  (i|  is  the  distance  between  the  two  points  at  which  derivatives  are  taken). 
Typically  the  roots  of  the  polynomial  in  x,  will  be  distinct  and  there  will  be  a  unique  zero 
eigenvector  of  the  matrix.  Thus  we  have  proved  that  n  derivatives  at  two  points  determine 
uniquely  (modulus  a  common  scaling  factor)  the  2n  moments  of  a  polynomial  of  degree  2n. 
The  case  of  multiple  zero  eigenvectors  is  nongeneric,  i.e.,  an  arbitrarily  small  perturbation 
in  the  "image"  would  annihilate  eventual  multiple  zero  eigenvectors.  Furthermore,  multiple 
zero  eigenvectors  of  the  matrix  of  degree  2 n  must  also  be  multiple  zero  eigenvectors  of  all 
higher  order  matrices  which  is  even  more  unlikely  (except  on  a  set  of  measure  zero). 

Our  proof  is  limited  to  filtered  function  of  the  polynomial  type  (albeit  of  very  high  degree). 
We  now  stretch  an  argument  suggesting  that  the  result  holds  also  for  most  filtered  functions 
E(x,  y)  which  are  not  polynomials. 

Consider  the  homogeneous  system  of  equations  obtained  from  two  points  up  to  the  moment 
M>„.  Denote  with  A!  the  matrix  of  the  coefficients.  Let  A  be  the  matrix  of  the  coefficients  of 
the  inhomogeneous  system  of  equations  obtained  by  dividing  all  unknowns  Mt  to  MiN  by 
the  first  moment.  The  system,  AM'  —  Z ,  where  Z  is  the  first  column  of  A'  divided  by  M\, 
does  not  in  general  have  solutions  as  we  have  shown  (see  Appendix  4).  Furthermore,  A 
has  no  null  vector  (if  it  has,  then  A!  must  also  have  a  null  vector,  which  is  impossible  since 
detA'  ^  0.).  Then  there  is  a  unique  least  square  solution  of  the  equation  \\AM'  —  Z\\  —  0 
given  by  M'  =  A^Z,  where  A+  is  the  pseudoinverse  of  A  [see  Albert,  1972],  Thus  for  every 
finite  M  there  is  a  unique  least  square  solution  to  the  system  of  equations  AM'  =  A  but  no 
exact  solution.  As  n  goes  to  infinity,  however,  at  least  one  exact  solution  must  appear. 

To  summarize,  in  section  3.1  we  show  that  the  moments  of  the  signal  are  constrained  by  the 
derivn  ives  of  the  zero-crossing  contours  at  one  point.  Section  3.2  shows  that  the  moments 
are  equal  to  the  coefficients  of  the  expansion  of  the  unfiltered  signal  F\x)  in  our  Hermite-like 
expansion  (and  also  equal  the  coefficients  of  the  Taylor  expansion  of  the  filtered  signal 
E{x,  t)).  In  section  3.3  we  show  how  we  can  combine  constraints  from  two  different  points 
on  the  zero-crossing  contours  at  the  same  scale.  Finally,  section  3.4  demonstrates  that  the 
equations  obtained  in  this  way  from  two  points  determine  a  unique  solution.  The  stability  of 
the  solution  was  briefly  discussed  in  section  2. 


4.  The  Extension  to  Two  Dimensions 

The  function 


E(i)  =  E(z,  0  )=  f  e*“V/(a)*t  (4-1) 

can  be  expanded  in  terms  of  the  <pn(x,t)  and  y?„(y(t)  as 

^(z)  =  52  «»m(lK(i,  t)y>m(y,  t)  (4.2) 

n,m 


with  the  coefficients  given  by 

Onm(0  =  (F(x),  V)„(x,  t)wm(y,  t))  =  J \*uJ)”{iuv)me~iL,t  (4.3) 

We  define  T{ w)  as 
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**■ 


T(w)  =  e^iw2/(y)e-y’e 
and 


£(s,t)  =  J  T(y)dy. 

We  now  take  derivatives  of  2?(x,  t)  on  the  zero-crossing  surface.  Thus  with 


the  first  equation 


—  —  &  8 
rff  d{  dx  df  dy  <ff  dt 


gives,  where  y  =  (ux,uv)  =  (<^1,^2)  and  wa  =  w*1  +  uya, 


dx 

di 


/ 


“j“ 


/ 


w2T(y)dy  =  0 


and  the  second  equation 


(4.4) 

(4.5) 

(4.6) 

(4.7) 

(4.8) 


gives 


(4.9) 


■jpr  J  w,T(w)dw- f  0  J  wJr(y)<fci 

1  *  ,  (4.10) 

+  2—  y  u2UiT(u)dtji 

+  (^)  / Wnyjdy-O 

where  we  use  the  summation  convention  over  »,>. 

These  equations,  and  the  higher  order  ones  that  can  be  obtained  in  the  same  way,  are 
equations  in  the  moments  5mp,  where 


Smrq  =  J  WJ’XwJT(y)dy.  (4-11) 

The  n-th  order  equation  will  consist  of  terms  of  the  type  Smpq  with  m  +  p  +  q  <  n.  We  will 
show  that,  using  different  curves  on  the  zero  crossing  surface  through  (x0,yo,fo).  we  can 
produce  one  equation  for  each  pair  of  moments  with  m  +  p+g  =  n  in  terms  of  the  moments 
with  m  +  p  -f  g  <  n.  As  in  the  I  D  case  we  have  half  the  equations  we  need  to  solve  for 
the  moments.  Again  we  can  consider  a  second  point  on  another  zero-crossing  contour  (at 
the  same  scale).  Combining  the  equations  from  two  points,  after  a  change  of  basis,  yields 
enough  information  to  determine  the  image. 
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There  are  an  infinite  number  of  curves  on  the  zero  crossing  surface  which  pass  through 
any  given  point  (zo.yo.Ai).  Since  the  surface  is  two-dimensional,  the  tangents  to  these 
curves  form  a  two-dimensional  vector  space.  Each  curve  will  give  different  equations  for 
the  moments.  We  will  show  that  by  taking  different  curves  through  the  same  point  (x0,y0,t0) 
we  can  nearly  obtain  enough  linearly  independent  equations  to  determine  the  moments. 
As  in  the  one-dimensional,  case  we  show  that  we  can  obtain  the  remaining  information  by 
considering  the  behaviour  at  a  second  point  on  the  zero-crossing  surfaces. 

We  first  consider  the  lowest  order  equation  (4.8).  As  we  mentioned  above  there  are  two 
linearly  independent  tangents  to  the  zero-crossing  surface  at  ( x0,yo,to )•  Thus  we  have 
two  linearly  independent  vectors  (^,  ^-)  and  (^,  #■)  where  we  use  c,  and  f2  to 

denote  the  parameters  on  the  two  curves.  We  can  substitute  these  vectors  into  equation(4.8) 
and  obtain  two  equations  for  three  unknowns  (the  three  moments  with  n  =  1).  These  are 
sufficient  to  determine  the  moments  up  to  a  scaling  factor.  This  factor  corresponds  to 
scaling  the  image  1  and  cannot  be  determined  from  the  zero-crossings. 

We  now  consider  the  n  th  order  equations  and  show  that  there  is  one  equation  for  each  pair 
of  moments  with  p  +  g  +  m  =  nin  terms  of  the  moments  with  p+  q  +  m  <  n.  The  moments 
we  need  to  solve  for  are  the  Smp,  with  m  -+-  p  +  g  =  n.  Fix  m  and  consider  the  moments 
as  p  and  g  vary.  There  are  n  —  m  -f  1  possible  moments,  however  we  will  show  that  only  2 
of  them  are  independent.  The  moments  are  given  in  equation  (4.11).  Adding  the  moments 
S,n,p,q  and  Sm,r+ 2, ,-2  gives  us  the  moment  Sm+i,P),_2.  Now,  since  m-\-  p  +  q  —  n,  we  find 
(m  +  1)  +  p  +  (q  —  2)  =  n  —  1  and  so  the  moment  Sm+i.p,,_2  is  of  order  n  —  1  .  Thus  if 
we  know  Sm,p,q  we  also  know  Sm,p+2i,- 2-  We  can  repeat  this  argument  adding  2  to  p  and 
subtracting  2  from  q  or  vice  versa.  Thus  if  we  know  the  moments  and  Smii,n_m_i 

we  can  use  this  argument  to  find  the  other  moments.  Hence  for  each  value  of  m  there  are 
only  2  independent  moments.  The  case  m  =  n  is  special  and  only  has  one  term,  m  can 
vary  from  0  to  n  and  so  there  are  a  total  of  2n  + 1  independent  moments  with  m-fp+g  =  n. 
We  show  that  for  each  m  it  is  possible  to  get  one  equation  for  the  two  moments. 

The  coefficients  of  the  unknowns  will  be  Apqm  where 


A 


PVn  — 


n!  f  dt\m  f  dx\p  f  dy  \? 
m\p\ql\ds)  Vdf/  WfJ 


(4.12) 


evaluated  at  x0,yo,t0  and  thus  the  expansion  containing  the  unknowns  is  of  the  form 


^  ^  AmpqSmpq  (t.13) 

We  consider  now  the  terms  for  a  fixed  n.  Since  we  can  take  the  derivatives  along  arbitrary 
directions  on  the  surface,  the  terms  dx/df  and  dy/df  take  independent  values  (while  dtjd( 
is  constrained  since  the  curve  must  lie  on  the  zero-crossing  surface).  We  will  show  that  it 
is  possible  to  eliminate  all  the  new  moments  (those  with  m  +  p-f  g  =  n)  with  m  >  0  and 
obtain  one  equation  for  the  two  independent  moments  with  m  =  0.  In  a  similar  way  we 
can  get  one  equation  for  the  two  independent  moments  with  m  =  1  and  so  on.  First  we 
eliminate  the  moment  with  m  =  n.  We  consider  N  curves  with  parameters  (f » ,  fa.  •  -.fw)-  We 
normalize  the  curves  by  requiring 


-£  =  1,»  =  1,2,...  N  (4.14) 

This  is  always  possible  unless  we  are  at  an  extrema  of  the  zero-crossing  surface.  Suppose 
we  write  down  the  n  th  order  equations  corresponding  to  two  different  curves.  From 
equations  (4.12)  and  (4.13)  the  coefficients  of  5„.0.o  are  unity  in  both  cases.  Thus  we  can 
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subtract  one  equation  from  the  other  and  obtain  a  linear  equation  for  the  new  moments  with 
m  <  n. 

Now  we  show  we  can  eliminate  the  m  =  n  and  m  =  n  —  1  moments  simultaneously.  We 
take  three  curves  with  parameters  fi.fa.  f3  and  add  the  three  resulting  n-th  order  equations 
multiplying  the  first  by  X  the  second  by  n  and  the  third  by  v.  Comparing  coefficients  of 
Sn,o,o.  — 1,1,0  and  5n_li0,i  gives  us  three  simultaneous  equations 


\  +  ?  +  v  =  0, 


(4.15) 


dx  ,  dx 

+iAir,+u«; 


=  0, 


(4.16) 


.  dy  dy 

+l‘dT,+‘'ir> 


o, 


(4.17) 


These  can  always  be  solved  since  the  tangent  vectors  (i.e  the  vectors  (1,  ^))  form  a  two 

dimensional  vector  space  and  hence  any  three  vectors  in  this  space  are  linearly  dependent 
and  satisfy  equations  (4.15),  (4.16)  and  (4.17).  Note  that  if  two  curves  are  the  same  we 
can  satisfy  these  equations  but  the  resulting  equation  for  the  moments  will  vanish.  Let 
the  normal  to  the  zero  crossing  surface  be  (r»i ,  n2,  n3).  Then  the  curves  must  satisfy  the 
equation 


dx 

ni  4  n2*rr  4*  n3 


dy 

d(i 


0 


(4.18) 


So  we  can  only  vary  one  of  $f-  and  independently. 

Now  we  try  to  eliminate  the  moments  with  m  =  n,m=n-l  and  m  —  n  —  2.  We  combine 
the  n-th  order  equations  from  curves  with  parameters  f*  multiplying  the  equations  by  X< 
and  taking  the  sum.  The  coefficients  of  the  moments  S„,0,o,  Sn—i.t.o,  Sn-i.o.i.  Sn-2,2,0  and 
Sn- 2,1,1  (using  Sn_2i0,2  =  5„_,,0,o  — 5„_2,2,o.  where  Sn_1>0>o  is  a  lower  order  moment)  form 
a  vector  L 


( 


& 

£ 


\ 


1 


(4.19) 


where,  for  simplicity,  we  have  incorporated  the  factors  of  n  into  the  moments.  To  eliminate 
the  moments  with  m  >  n  —  2  we  must  solve 


N 

X)  \ili  =  0.  (4.20) 

i— t 

Because  of  equation  (4.18)  there  are  only  three  linearly  independent  vectors  which  can  be 
formed  by  varying  the  ^  and  taking  linear  combinations.  Thus  if  N  =  4  we  can  solve 
the  equations  (4.20)  and  eliminate  moments  with  m  >  n  —  2.  By  increasing  the  number 
of  curves  by  1  each  time  we  decrease  m  by  1  we  can  eliminate  all  the  moments  with 
m  >  1.  We  are  left  with  one  equation  in  the  two  unknown  moments  with  m  =  0.  In  a 
similar  way  we  can  eliminate  all  the  moments  except  the  two  with  m  =  1  and  obtain  one 
equation  for  these  two  moments.  We  repeat  this  process  for  the  higher  order  moments. 


13 


Yuilie,  Poggto 


Thus  the  n-th  order  equations  give  us  one  equation  for  each  pair  of  independent  moments 
with  p  +  q  +  m  =  n.  If  we  consider  all  the  equations  as  n  varies  we  find  that,  as  in  the  I  D 
case,  at  each  point  on  a  zero-crossing  contour  we  have  only  half  the  number  of  equations 
needed  to  solve  for  the  moments.  As  in  the  one-dimensional  case  we  now  consider  a 
second  zero-crossing  surface  at  the  same  value  of  t  and  repeat  the  argument.  We  change 
the  basis  of  the  Hermite  polynomials  as  in  section  3.3  and  obtain  enough  equations  to  solve 
for  the  moments.  Substituting  these  into  the  equation  (4.2)  for  F(x)  completes  the  proof  of 
Theorem  2. 


5.  Examples 

We  now  illustrate  the  theorems  by  considering  some  special  cases.  If  the  signal  is  a  low 
order  polynomial  in  X ,  it  is  possible  to  obtain  the  zero  crossing  curves  explicitly.  We  then 
use  the  derivatives  of  these  curves  to  reconstruct  the  image,  as  in  the  theorem.  These 
examples  also  suggest  that  the  derivatives  of  the  curves  at  a  single  point  will  usually  give 
sufficient  information  to  reconstruct  the  signal. 

Suppose  the  signal  F(X)  is  a  second  order  polynomial  in  X. 

F(X)  =  1  +AX  +  BX 2  (5.1) 

where  A  and  B  are  arbitrary  coefficients.  All  the  moments  of  the  signal  are  zero  except  for 
the  first  two.  We  convolve  this  signal  with  a  gaussian  at  scale  o  and  obtain 

E(X,  <r)  =  1  -f  AX  -f  BX2  -f  Bo2  (5.2) 

We  consider  the  curves  given  by 

E(X,o)  =  0  (5.3) 

We  write  these  in  the  form 

+  {X2  +  [A/B)X  +  1/5)  =  0  (5.4) 

and  see  that  they  correspond  to  circles  in  the  (X,o)  plane.  Define  Xt  and  X2  by 


XyX2  =  1  IB 
-(*,  +Xi)  =  A/B 

Then  we  can  rewrite  the  equations  as 


(5.5) 


,.  +  {*-(^)}’-(*L=*)'  ,5,) 

Thus  the  zero  crossing  curve  corresponds  to  a  semi-circle  which  intersects  the  X-axis  at 
X\  and  X2  (see  figure  2). 

We  now  parameterize  the  curve  by  an  angle  0  so  that 


a(t)  ^  —  J-*1  )*'mJ 


(5.7) 


] 
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(— bsinOi 
—bcosO  j 


b7stn6iCos$i  0  0  A I  M2 

b7cos70i  —  263«in2fij co»6\  64amJ0)CO320i,/l  M3 

\Ma 


-0 


We  pick  another  point  on  the  curve  with  the  same  value  of  a.  This  point  has  parameter 
02  =  k  —  0,  (with  0  <  $i  <  ir/2).  This  gives  us  a  second  equation 


(— batnOx 
bcosO  j 


— 62«i'ntf,co«tfi  0  0  \\  o  1  Xx  X\I2[ 

2co32$i  2b* si n7 6 i cos3 $}  b* sin70\cos70\ )\  q  Q  1  Xi  ^3 


1  Xt  §  X]/3\ \(M'\ 

0  1  Xi  X7/2\  II  ^2  I  =  ^ 
n  n  i  x,  ^3  W 


0  0  0  1 


Now  we  consider  the  equation  for  the  first  two  moments  obtained  by  taking  the  first  derivative 
at  both  points.  From  (5.11)  and  (5.12),  this  becomes 

(— 63«n0j  b7sin0icos9i  \/Mi\  _  /OV  f5  13) 

— bstnffi  —b7sin6iCosffi  —  XibstnOi  VO/ 

The  condition  for  there  to  be  a  solution  of  (5.13)  is  that  the  determinant  of  the  matrix 
vanishes.  This  occurs  at 

Xi  =  — 26coa0|  (5.14) 

From  (5.7),  we  see  that  this  is  indeed  the  distance  between  the  two  points  and  so  we  can 
solve  for  M,  and  M2.  We  obtain: 


Mi  =  bcosO j  Mj 


Substituting  for  bcosOi  from  (5.7)  yields 


M,=(xo-{^i-^})Ma 


where  X0  is  the  position  of  the  first  point.  The  reconstructed  function  is 


F(X)  =  -Mt<p,{X  -  X0,Oi)  +  M2p2(X  -  X0,o) 
Without  loss  of  generality  set  X„  =  0.  Then  up  to  a  scale  factor 


{*!-(-*•,}  X  1 

2  y/2 rot  2y/2* 


{— e 


Now  Oi  lies  on  the  circle 


at  the  point  where  X  —  0.  Hence 


o\  «  -XiXt 


/ 
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Note  that  Xi  and  X2  have  opposite  signs  if  X  =  0  lies  on  the  circle.  Substituting  (5.20)  into 
(5.18)  gives 


F(X)  =  1  -{XiX2  -  (X,  +  X2)X  +  X2}  (5.21) 

2v/W-X,X, 

From  (5.1)  and  (5.5),  we  see  that  this  is  indeed  the  original  function  up  to  a  scaling  factor. 
Thus  we  have  demonstrated  how  to  reconstruct  the  signal. 

We  should  check  that  X!  =  —  26coj0i  remains  a  root  of  the  determinant  for  the  higher  order 
determinants.  We  will  calculate  the  result  for  the  case  n  =  2.  From  (5.11)  and  (5.12),  the 
determinant  equation  becomes  (in  unconventional  notation) 


r— bsinBi  b2  sxn0\co»0\ 

~bcos0  i  b2cos20i 

— bstnffj  — X^ijn^i  —  b23tn20jCO30j 
^bcosOi  XIbcos0i  -j-b2cos20i 


0  0  ' 

— 2b3sin2OiCO30i  b4stn201cos20i 

=^f1b23in01co30i — X\b2  3\n0\cos0i  C 

X\/2\bco30\  -f- X\b2co320\  +  263«tn201coj201  B  j 

[5.22) 


where  C  =  — ^bsinOi  —  ^fb23tn0,co30i  and  B=  ^ f-bcos0i-{-^co3201  -i-X12b33in20ico320I-j - 
b*3tn20,co320,.  Dividing  the  matrix  by  factors  common  to  rows,  this  becomes 


/—  1  bcosB  i 

—  1  bcos0l 

—  1  —  Xj  —  bcosOi 
^1  Xi  -f-  bcos0\ 


0 

-262J.n20, 

— X2/2!  —  Xi&cosflj 

Xj/2!  4-  Xibco30t  -(-  262 sin2 0ico$01 


b3sin20icos0i 
— Xj/3!  —  X2/2\bcos01 
V 


=  0 
(5.23) 


where  V  =  ^  -f  -f  Xi2625«n2flIco3fl1  +6 3sin20icos0i.  By  adding  and  subtracting 

rows,  this  reduces  to 


1  bco30, 

0  0 

0  — Xi  —  2bco30t 

.0  0 


0 

— 262  .s»n20] 

-X2IV.~Xxbco30x 

262jin20iCO30i 


b3sin20icos0\ 

-Xf/3!  -  X21/2\bcos01 
S 


=  0 


(5.24) 


where  S  =  Xi2523«n201cos5i  +  b3sin20lcos0i.  Thus,  the  equation  becomes  (removing 
common  factors) 


(Xj  -f*  2bco$0\] 


-1 
CO30 1 


2Xi  +  6 


(5.25) 


and  can  be  expressed  as 


(X,  +  26co30,X2X,  -f  6+  bcoiBx)  =  0  (5.26) 

Hence,  X!  =  —  26coj$i  remains  a  root  for  the  n  =  2  case. 

We  turn  now  to  another  example  and  an  alternative  approach  to  the  problem  of  determining 
the  image  from  the  zero-crossings  across  scales.  Let  the  signal  be  a  third  order  polynomial. 
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F(X)  =  A  +  BX  4  CX 2  +  X*  (5.27) 

If  we  know  that  the  signal  is  a  third  order  polynomial  we  can  determine  its  coefficients  by 
derivatives  of  the  zero-crossing  contours  at  a  single  point.  It  is  straightforward  to  show  that 
this  gives 


E{X,  t)  =  A+BX  +  CX2  +  X3  4  2  (C  4  3X)t  (5.28) 

The  zero  crossings  curves  are  given  by 

A  +  BX  +  CX2  +  X3  4  2  (C  4  3  X)t  =  0  (5.29) 

We  will  show  that  by  taking  a  sufficient  number  of  derivatives  at  one  point  it  is  possible  to 
reconstruct  the  signal.  From  (5.29),  we  calculate 


B  +  2  CX  +  3X2  4  6t  4  2(C  4  3X)^  =  0  (5.30) 

dx 

2C  +  6X  +  2{C  4  3X)^  4  12—  =  0  (5.31) 

dzl  dx 

(fit  d*t 

6  418^4  2(C43X)SI  =0  (5.32) 

At  a  point  X  are  known.  We  write  (5.29),  (5.30),  (5.31)  as  equations  in  the 

unknowns  A,  B,  C. 

fl  X  X2  4  2t  \{A\  f-X3-SXt\ 

0  1  2X4  2^  S  =  — 3X2— 6<  (5.33) 

VO  0  2  4  2$-  J  \cJ  I"6*  ~  12 

It  will  be  possible  to  solve  these  equations  uniquely  for  A,  B,  and  C,  provided  the  determinant 
of  the  matrix  on  the  left  hand  size  is  nonzero.  But  the  matrix  is  the  Wronskian  of  the  functions 
1,  X,  X2  4  2 1.  Except  for  a  set  of  measure  zero,  which  we  discard,  it  will  only  vanish  if 
the  functions  1,  X,  X2  4  2t  are  linearly  dependent.  But  from  (5.29)  we  see  this  can  only 
happen  if  the  function  (C  4  3X)  divides  the  function  (4  4  BX  4  CX2  4  X3).  Apart  from 
this  special  case,  the  determinant  of  the  matrix  will  be  non  zero  and  it  is  possible  to  solve 
for  A,  B  and  C. 

We  now  consider  the  special  case.  The  condition  that  (C43X)  divides  (A4flX4CX24-X'3) 
is 


and  the  result  is 


3 A  2  C2 

~  C  +  9 


(5.34) 


2CX 

9 


+  £+’!  =  0 


(5.35) 


Note  firstly  that  although  for  the  general  third  order  polynomial  (5.29)  there  are  usually  three 
zero  crossing  curves,  there  are  now  only  two.  Secondly,  this  equation  is  of  similar  form  to 
equation  (5.4)  for  the  second  order  polynomial  but  the  relative  coefficients  of  a2  and  X2  are 
different,  so  the  two  ca>-.es  can  be  distinguished. 
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We  can  differentiate  (5.35)  and  show  that  the  coefficients  A  and  C  can  be  determined  at  a 
single  point. 

It  seems  likely  that  this  result  will  apply  to  all  polynomials  functions  F(X).  Hence  knowledge 
of  the  degree  of  the  polynomial  signal  allows  reconstruction  from  derivatives  at  a  single 
point.  It  is  furthermore  likely  that  the  degree  of  the  image  could  be  determined  by  the  shape 
of  the  zero  crossing  contours.  If  this  conjecture  is  true  this  would  represent  an  alternative 
constructive  proof  of  Theorem  1. 


6.  Conclusions 

We  conclude  with  a  brief  discussion  of  a  few  issues  that  are  raised  by  this  paper  and  that 
will  require  further  work. 

a) Stability  of  the  reconstruction.  Although  we  have  not  yet  rigorously  addressed  the  question 
of  numerical  stability  of  the  whole  reconstruction  scheme,  there  seem  to  be  various  ways  for 
designing  a  robust  reconstruction  scheme.  The  first  step  to  consider  is  the  reconstruction 
of  the  filtered  signal  £’(x,f).  One  could  exploit  the  derivatives  at  n  points  -  at  the  given  a  - 
and  then  solve  the  resulting  highly  constrained  linear  equations  with  least  squares  methods. 
Alternatively,  it  may  be  possible  to  fit  a  smooth  curve  through  several  points  on  one  contour, 
and  then  obtain  the  derivatives  there  in  terms  of  this  interpolated  curve.  The  same  process 
must  be  performed  on  a  second  separate  zero  crossing  contour.  This  scheme  provides  a 
rigorous  way  of  proving  that  instead  of  derivatives  at  two  points,  the  location  of  the  whole 
zero-crossing  contour  across  scales  can  be  used  directly  to  reconstruct  the  signal  (since 
the  Implicit  Function  theorem  shows  that  the  zero-crossing  curve  is  C°°). 

The  second  step  involves  the  reconstruction  of  the  unfiltered  signal  /(x).  We  have 
constructed  V-/  explicitly.  The  construction  is  in  terms  of  Hermite  polynomials  which 
can  be  integrated  up  straightforwardly  to  give  us  I  (up  to  a  function  <f>  such  that  =  0). 
Alternatively  we  can  consider  F(x)  to  be  the  second  moment  of  /( x)  (see  equation  (3.2.7)) 
and  then  use  the  moment  equations  to  determine  the  second  and  higher  order  moments  of 
/(x)  leaving  the  first  two  moments  undetermined.  This  reconstruction  step  is  unstable,  as 
we  discussed  earlier,  if  only  one  scale  is  used,  /(x)  can  of  course  be  reconstructed  only 
modulus  the  null  space  of  the  (differential)  operator.  When  the  differential  operator  is  the 
Laplacian  and  E(x,t)  is  available  for  all  t,  then  the  representation  is  invertible  and  J(x)  can 
be  recovered.78 

b)  Degenerate  fingerprints.  Our  uniqueness  result  applies  to  almost  all  signal:  a  restricted 
but  well  known  class  of  signals,  with  vertical  zero-crossings  in  the  scale-space  diagram, 
correspond  to  nonunique  fingerprints.  These  signals,  which  will  be  discussed  in  a  forthcom¬ 
ing  paper  [Yuille  and  Poggio  1983,  in  preparation],  do  not  belong  to  the  class  P  introduced 
in  Theorem  1  and  2.  Interestingly,  level-crossings  (with  a  level  different  from  zero)  can 
distinguish  between  elements  of  this  class.  Note  that  there  is  a  further,  obvious  constraint 
on  the  reconstruction:  the  original  signal  7(x)  can  be  reconstructed  modulus  the  null  space 
of  the  (differential)  filter. 

c)  Extensions.  Our  main  results  are  not  restricted  to  second  derivatives.  They  apply  to  zero- 
and  level-  crossings  of  a  signal  filtered  by  a  gaussian  filter  of  variable  size.  They  also  apply 

7  This  reconstruction  scheme  may  play  a  role  in  the  computation  of  lightness  in  the  vertebrate  visual 
system,  (Poggio,  possibly  in  preparation). 

"Notice  that  it  may  often  be  possible  to  assume  that  the  image  is  an  analytic  entire  function,  i.e.,  a 
distribution  already  "diffused "  by  the  imaging  process.  In  this  case,  the  Hermite  expansion  converges 
analytically  everywhere  and  so  does  the  associated  Taylor  expansion.  If  the  convergence,  however, 
can  only  be  ensured  in  l?  (i.e.,  the  image  is  not  analytic)  there  may  be  some  parts  of  the  image  where 
the  series  expansion  is  not  a  faithful  representation.  We  conjecture  that  it  should  usually  be  possible 
to  infer  the  presence  of  such  an  anomalous  region  from  the  behavior  of  the  derivatives  of  the  image. 
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to  transformations  of  a  signal  under  a  linear  space- invariant  operator  -  in  particular  they 
apply  to  the  linear  derivatives  of  a  signal  and  to  linear  combinations  of  them.  In  both  1-D 
and  2  D,  local  information  at  just  two  points  is  sufficient.  In  practice,  since  many  derivatives 
are  needed  at  each  point,  information  about  the  whole  contour,  to  which  the  point  belongs, 
is  in  fact  exploited. 

d)  Are  the  fingerprints  redundant?  The  proof  of  our  theorem  implies  that  two  points  on 
the  fingerprint  contours  are  sufficient.  As  we  mentioned  earlier,  several  points  are  probably 
required  to  make  the  reconstruction  robust.  We  conjecture,  however,  that  the  fingerprints 
are  redundant  and  that  appropriate  constraints  derived  from  the  process  underlying  signal 
generation  (the  imaging  process  in  the  case  of  images)  should  be  used  to  characterize  how 
to  collapse  the  fingerprints  into  more  compact  representations.  Witkin  made  already  this 
point  and  discussed  various  heuristic  ways  to  achieve  this  goal. 

e)  Implications  of  the  results.  As  we  discussed  in  the  introduction,  our  results  imply  that 
the  fingerprint  representation  is  a  complete  representation  of  a  signal  or  an  image.  Zero- 
and  level-crossings  across  scales  of  a  filtered  signal  capture  full  information  about  it.  These 
results  also  suggest  a  central  role  for  the  gaussian  in  multiscale  filtering  that  assure  that 
zero  and  level-crossing  indeed  contain  full  information.  Note,  however,  that  the  fingerprint 
theorems  do  not  constrain  or  characterize  in  any  way  the  differential  filter  that  has  to 
be  used.  The  filter  may  be  just  the  identity  operator,  provided  of  course  that  enough 
zero-crossings  contours  exist.  Independent  arguments,  based  on  the  constraints  of  the 
signal  formation  process,  must  be  exploited  to  characterize  a  suitable  filter  for  each  class 
of  signals.  For  images,  second  derivative  operators  such  as  the  Laplacian  are  suggested  by 
work  that  takes  into  account  the  physical  properties  of  objects  and  of  the  imaging  process 
(Grimson,  1982;  Poggio  and  Torre, in  preparation;  Yuille,  1983).  We  plan  to  explore  this 
approach  in  the  near  future. 
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Appendix  1 


Properties  of  Hermite  polynomials  and  truncation  of  the  expansion 
The  set  of  Hermite  functions  is  defined  by 


tM2)  = 


e=t-Hn(x) 


where  Hn  are  the  Hermite  polynomials. 


’  PI 

The  Hermite  functions  are  an  orthonormal  basis  of  functions  which  is  complete  for  L2 
functions.  The  completeness  is  expressed  by 


and  the  orthonormality  by 


X)  =  Hx  -  r) 


J  i>n{x)'Pm{x)dx  =  £„ 


In  general,  the  Hermite  expansion  of  a  L2  function  does  not  converge  uniformly,  but  only  in 
the  L 2  norm.  The  series  will  converge  to  the  function  except  at  a  set  of  point  of  measure 
zero.  At  any  point,  the  series  can  be  truncated  at  a  term  of  order  N  such  that  the  remainder 
of  the  series  is  arbitrarily  small.  If  we  only  consider  a  finite  number  of  points  where  the 
series  converges,  the  series  can  be  truncated  and  the  function  approximated  arbitrarily  well 
by  a  finite  number  of  Hermite  components. 

The  Hermite  polynomials  defined  in  equation  [2]  and  the  set  of  function  tun(x)  defined  as 
(see  equation  3.2.6): 

u>n(x)  =  — I5) 

2nn!v/*<l1 

are  biorthogonal  sets  of  functions,  i.e., 


J  Hn(x)wm(x)dx  =  6„ 


They  also  obey  a  completeness  property 


£  Hn(x)wn(t )  =  S(x  -  f) 


and  therefore  a  L2  function  f(x)  can  be  expanded  in  either  set  of  functions 

n 

/(*)  =  £  b*w«{x) 
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with 


an  =  (f,ru  n> 

*»=(/,#») 


[9) 


Appendix  2 


Analytic  properties  of  solutions  of  the  diffusion  equation 

For  completeness  we  provide  results  about  the  analytic  properties  of  functions  convolved 
with  the  gaussian,  i.e.  solutions  of  the  heat  equation  with  the  Huygens  property  (see  later). 
Notice  that  images  can  be  considered  to  have  undergone  already  a  "diffusion",  since  the 
imaging  process  has  the  effect  of  convolving  the  light  distribution  with  a  point  spread 
function,  usually  very  close  to  a  gaussian. 

Lemma:  The  solutions  of  the  diffusion  equations  u(x,t)  as  functions  of  x  for  a  given  t  are 
restrictions  to  reals  of  functions  which  are  entire  functions  of  the  complex  variable  (Widder, 
1975,  page  64).9 

This  result  is  noteworthy.  The  condition  that  uzz  =  v,  automatically  brings  with  it  C°°  for 
u(x,  t)  and  even  analyticity  for  the  space  variable  x.  Considered  as  a  function  of  t,  u(x,t)  can 
be  extended  analytically  into  the  complex  plane,  although  it  will  not  generally  be  analytic 
(see  Widder,  1975,  page  65). 


=  £on(i,<r)vn(x,a) 

n 

The  heat  polynomials  v„  are  defined  as  the  coefficients  of  £f  in  the  expansion  of 


n«0 


where  t  —  vn  is  a  polynomial  of  degree  n  and  is  given  by 


[1] 


Mx>  *) 


,  y?  tk  xn~2* 
n'  *=0  V.(n-2k)\ 


They  are  related  to  the  Hermite  polynomials  Hn  by 


vn(x,t)  =  (-f)"/2tfn 


12] 


(3) 


The  heat  polynomials  are  solutions  of  the  diffusion  equation.  Among  other  nice  properties, 
they  obey  the  following  theorem  [Widder,  1975]. 

Theorem:  Any  function  which  obeys  the  diffusion  equation  and  has  the  Huygens 
property  can  be  expanded  in  a  series  of  heat  polynomials  which  converges  uniformly  in 
(M). _ 

*  Entire  functions  are  functions  which  are  analytic  everywhere. 
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A  solution  u(z,t)  of  the  diffusion  equation  is  said  to  have  the  Huygens  property  if  it  can  be 
expressed  as  the  convolution  of  the  Gaussian  with  its  initial  value  at  t  —  0.  Filtered  images 
satisfy  this  requirement  by  definition. 

This  theorem  is  important  since  it  ensures  that  the  expansion  converges  not  only  in  the 
square  integrable  norm,  as  is  usually  the  case,  but  also  uniformally  (i.e.,  at  each  point).  This 
ensures  that  undesirable  behavior,  like  the  Gibbs  phenomenon,  does  not  end. 


Appendix  3 


Convergence  of  change  of  basis 
We  can  write  F(x)  in  terms  of  the  bn's  as 

OO 

F(x)  =  22  6"(1Vn(l  +  Xi,t).  (1) 

n*»0 

This  series  converges  in  the  I ?  sense:  given  an  e  >  0,  however  small,  it  is  possible  to  find 
an  N i  such  that 


J  (F(x)  “  22  6n(0<°n(l  +  dx  <  £. 


Using  (1)  we  can  write  equation  (2)  as 


J  (  22  6»(0tPn(* +  *!,<))  dx 

J  Vn-N.+X  ' 


<  e. 


Similarly  for  the  expansion  of  F(x)  in  terms  of  on’s  we  can  find  an  N2  such  that 


(2) 


(3) 


£ 


n-«0 


dx  <  t. 


(4) 


Set  N  =  max(Ari ,  N2).  If  we  can  cut  off  the  series  for  F[x)  at  N  then  we  can  change  the 
basis,  as  in  subsection  3.3.1.,  equate  coefficients  of  the  and  hence  relate  the  on,s 

to  the  bn' s.  We  would  then  have  N  equations  for  the  first  N  moments.  We  now  show  that 
cutting  off  the  series  is  permissible:  if  we  choose  e  sufficiently  small  we  can  make  the  error 
involved  as  small  as  we  like. 

The  an's  are  related  to  the  6„’s  by 


On(f)  = 


} 


(5) 


This  can  be  written  as 


N 


On(f)  =  (  22  MOvK*  +  Xl1f).tyn(z,f))  +  (  22  bn{t)lfi(x  +  Xi,t),Wn(x,t)y  (6) 

n-0  /  \n-N+l 


23 


Yuille,  Poggio 


The  second  term  is  called  a„  and  is  neglected  when  we  cut  off  the  series  at  N.  We  must 
now  show  that  this  is  justified.  We  can  write  its  square  as 


an(4)  =  (/^  52  bn(t)<p[x  +  2i,ojwn(i,t)dij 


Using  the  Cauchy-Schwarz  inequality  we  obtain 


(f  ^  52  +  <  J  Wn(x,t)2dx  J ^  52  bn{t)<p[x  +  XUt)j  <1X. 


The  first  term  on  the  right  hand  side  of  (6)  is 


On-  an  =  (52  MOvK1  +  *!.*)>  wn(x,t)j. 


Hence,  using  (8)  and  (3),  we  have 


(8) 


(9) 


a„2 


(10) 


Thus  if  we  make  e  very  small  the  errors  5„’s  will  be  negligible  (we  can  scale  v>n{x,t)  and 

<pn(x,t)  by  functions  of  n  so  that  f(w„(x,t)J  dx  tends  to  a  finite  limit  as  n  tends  to  oo; 

alternatively,  note  that  both  a„(z,t)  and  on  —  5„  depend  linearly  on  wn{x,t)  and  so  scaling 
it  will  not  alter  their  relative  sizes). 

The  errors  involved  in  terminating  the  series  can  be  made  arbitrarily  small  by  making  the 
cutoff  N  sufficiently  large.  Thus  we  can  change  the  basis  and  obtain  N  equations  for  the 
first  N  moments.  We  solve  these  equations  and  obtain  the  first  N  terms  in  the  expansion 
of  F[x)  in  terms  of  the  V3„('r,t).  Taking  the  limit  as  N  tends  to  oo  we  reconstruct  the  image 
(in  the  L2  sense). 
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We  will  show  that  the  20"*  order  determinant  is  generally  non  zero.  Recall  that  the 
determinant  is  a  polynomial  in  xi  (of  degree  at  most  2 n)  with  the  coefficients  being  functions 
of  the  first  n  derivation  of  the  curves  at  the  two  points.  If  this  determinant  always  vanished, 
it  would  mean  that  the  distance  between  any  two  curves  with  prescribed  values  of  their  first 
n  derivation  could  only  take  a  finite  set  of  values  (at  most  2 n)  whatever  the  values  of  the 
higher  order  derivation  of  the  curves.  We  will  show  that,  by  changing  the  values  of  the 
higher  order  derivatives,  it  is  possible  to  alter  the  value  of  A",  continuously  while  keeping 
the  first  n  derivation  of  the  curves  constant. 

We  take  two  points  (0,  ti)  and  (ii,  t,)  lying  on  zero-crossing  curves.  At  these  points, 
we  assume  we  know  the  derivatives  ...  up  to  order  n.  (This  means  we 

can  reconstruct  . '&{  from  the  implicit  function  theorem.)  We  can  use  the  diffusion 

equation  to  write  these  as  Qfi, 
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So  we  have 


and 


E(0,ti)  =  0 


d7nE 

d2nx 


(0,<i)  =  AT2 


n 


S(ii,ti)  =  0 


a2njg 

3z2n 


faliM  =  ^2n 


0) 


(2) 


where  Ku...,Kin  and  Ci,...,C2n  are  specified.  Now  we  will  try  to  alter  the  value  of  xi 
while  keeping  Ki,...,Kjn  and  Cx . Cin  constant. 

We  have 

E(x,t)  =  J  e'uxe~u,tu2I(u)du  (3) 

Introduce  a  “deformation"  parameter  X  and  a  function  V(w,X)  where 


Y{u>,  0)  =  u>2/(w) 


M 


and  xx  —  ai(X). 
Let 


E(x,  t,  X)  =  J  e'u*e~~ut,Y(u,  \)du 


(5) 


Allow  Z[(X)  to  vary  while  maintaining  equations  (1)  and  (2).  For  the  first  point  this  gives 


/  e-“,'l:r(W’X)<lw==0 

/  e“w,‘wan|^(w,X)du»  =  0 


(G) 


For  the  second  point  we  obtain 

f  eiu,x,  e-w’«(lw)y(Wi  xjdw  +  [  eivt'e~ut>  ~Y(u,\)du  =  0 
uX  y  j 

/ e,WI,<— W,‘(»w)wjny(w,  X)<k/  +  / Ay(W(  x)du>  =  0 
oX  y  y  o\ 

We  want  to  solve  equations  (6)  and  (7)  tor  $£(w,X)  in  terms  of  Then  the  result  follows. 

Equation  (6)  implies  that  the  first  2n  moments  of  X)  are  zero.  Equation  (7)  means  that 
the  first  2n  moments  of  ^(w,X)  take  prescribed  values.  (We  assume  y(w,X)  is  known 
but  not  &y(w,X).) 
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Expanding  eiuXl  as  a  Taylor  series  (and  using  equation  (6)),  we  write  equation  (7)  as 


(,m— 2n-fl  '  ) 

/  {  J  c'“*'e-“,t(iu)U'nY(U,\)<L> 


(8) 


The  ir  nts  of  &Y(u,  X)  are 


wm 


’*‘|-y(w,x)wmdU 


(9) 


and  define 


Ap  =  J  eiux>  e~u'*t(iw)wpy(w,  \)du 
Using  (9)  and  (10)  we  rewrite  equations  (8)  as 


t  m— 2n-H 


m! 


(10) 


(ii) 


oo 


E 


(ixi)m- Jn 
(m  -  2n)! 


Wm  —  ^2n+l 


It  will  always  be  possible  to  solve  these  equations  for  Wm  and  there  will  be  infinitely  many 
solutions.  To  see  this,  we  set 


Wm  =  0  ,  m  >  4n  -f- 1 


and  write  equation  (11)  as 


/  («*» ) 


W+T)r  1 


/  At  \ 
^4»+l/  VAa«+i  / 


(12) 


(13) 


It  is  possible  to  solve  (13)  if  the  determinant  is  non-zero.  The  determinant  is  of  form 
X(x,)|an+,)>.  (This  follows  directly  from  the  form  of  the  matrix)  and  so  is  either  zero 
for  all  X\  or  else  never  zero.  The  determinant  is  also  the  Wronskian  of  the  function 

. and  as  these  functions  are  linearly  independent,  it  cannot  vanish 

everywhere.  Hence  the  determinant  never  vanishes  and  we  can  solve  for  the  Wm’s  in  terms 
of  the  Ar’s.  Relaxing  the  condi'ion  (12)  gives  us  infinitely  many  solutions. 

Thus,  we  have  shown  that  it  is  possible  to  alter  x,  continuously  without  changing  the  values 
of  the  first  n  derivatives  at  both  points.  This  means  that  the  determinant  of  the  2n-order 
matrix  m  the  moments  wiil  in  general  be  non-zero;  it  can  only  be  zero  for  a  finite  set  of  xt 
and  there  are  an  infinite  set  of  possible  values  for  xt  compatible  with  the  first  n  derivatives 
at  the  points. 
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